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Abstract 

Ergodic parameters like the Lyapunov and the conditional expo- 
nents are global functions of the invariant measure, but the invariant 
measure itself contains more information. A more complete charac- 
terization of the dynamics by new families of ergodic parameters is 
discussed, as well as their relation to the dynamical Renyi entropies 
and measures of complexity. A generalization of the Pesin formula is 
derived which holds under weak correlation conditions. 
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1 Introduction 

Ergodic parameters associated to an invariant measure play a central role in 
the characterization of dynamical systems. In addition to rigorous notions 
of chaos, they also provide indicators of self-organization pQ, sufficient con- 
ditions for self-organized criticality [2] and a characterization of topological 
transitions in networks [3]. 

The Lyapunov [I] and the conditional exponents [5] [5J, are global func- 
tions of the invariant measure. However, the invariant measure itself contains 
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more information. Ergodic parameters, being obtained from infinite-time 
limits, are averages of local fluctuating quantities. The quantity describing 
the fluctuations is again an ergodic parameter and the same reasoning applies 
in turn to its fluctuations, etc. [7J. Therefore, unless the fluctuations are fluc- 
tuations of a Gaussian random variable, to fully characterize the invariant 
measure, a much larger set of parameters is in general needed. 

The task of constructing a larger set of ergodic parameters has already 
been addressed by several authors. For example, Farmer, Sidorowich and 
Dressier [8] [9] proposed to use infinite-time limits of higher order derivatives 
of the map. The existence status of these limits is weaker [10] (convergence in 
probability) than for the case of Lyapunov and conditional exponents. Also, 
whenever they exist, it turns out that they are simple functions of the Lya- 
punov exponents and therefore provide no new information. Other ergodic 
parameters, independent from the Lyapunov exponents, were proposed by 
several authors, either in the form of generalized entropies [UJ [12] [13], as 
moments of the local fluctuations of the tangent vectors [H] [15] [11] [16] [17] 
|18j or from the eigenvalues of the Hessian in a variational formulation . 

In this paper, a general cocycle formulation is used which allows to de- 
scribe in a unified way the generalized ergodic parameters that have been 
proposed in the past as well as a new ergodic parameter that subsumes all 
the information on the statistics of local fluctuations of the expansion rate. 
That multi-point correlations should also be taken into account in the ergodic 
descrition of dynamical systems is pointed out. 

Then, in Section 3, the moments of the local expansion rate are related 
to generalized entropies and in Section 4 one discusses how the ergodic pa- 
rameters may be used to characterize and quantify the notions of complexity 
and dynamical self-organization. 

2 Generalized ergodic parameters. A cocycle 
approach 

Let / : M — > M be a measure-preserving transformation of a Lebesgue space 
(M, £>,/i). For any measurable function g : M — > GL(N, R) and x G M 
define 

C(x,n)=g(f n - 1 (x))---g(x) (1) 
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and C (x, 0) =Id . Then 



C (x, n + k) = C (f k (x) , n) C (x, k) (2) 

and any measurable function C : M x Z — > GL (N, K) satisfying (j2J) is called 
a cocycle (over /). Any cocycle has the form (pQ) and the map g is called the 
generator of the cocycle. 

The Oseledets multiplicative ergodic theorem [20] is a powerful result 
insuring the existence of some infinite-time limits associated to a cocycle C. 
Namely, if 

hx + \\g{x)\\eL l {M^) (3) 

then : 

(i) there is a decomposition of M. 



l'E l (x) (4) 



invariant under C (x, n) 
(ii) and the limits 



lim — In ^ ^- — = %j (x) (5) 

n-^oo n ||f || 

with 

Xi ( x ) < X2 (x) < ■ ■ ■ < Xk(x) (x) (6) 

exist uniformly in v G Ei (x) \{0}. 
If the generator of the cocyle is 

9l (x) = Df (x) = e W (\n(Df (x))) (7) 

the quantities \% ( x ) are t ne usual Lyapunov exponents of the dynamics /. 
If the full Jacobian Df is replaced by partial blocks of Df one obtains the 
conditional exponents [5] [6]. However, provided that the integrability con- 
dition is satisfied, Oseledets' theorem applies to any other linear cocycle 
extension of /. 

Definition 1 The Lyapunov fluctuation moments xf ( x ) are defined as the 
limits (TJP when the generator of the cocycle is 

g p (x)=e W (\n p + (Df(x))) (8) 
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The definition of the logarithm in (jSJ) should be understood in the frame- 
work of the Oseledets-Pesin e— reduction theorem [2T] [22]. Namely, under 
the measurability conditions of the Oseledets theorem, for any e > there is 
an invertible map T £ (x) : M — > GL (N, M.) such that the generator 

g £ (x) = T- 1 (f(x))g(x)T(x) 

has block form, in each block 

e Xi{x)-e < ||^* (a;) V 1 1 < e xd*)+e 

and it generates a cocycle C e (x,n) equivalent to C (x,n). The ln + in (|S]) is 
therefore computed without ambiguity in each block and one sees that the 
limit 

x? (*) = hm i in hAr-Hf -aA^vW 

n^oo n \\v\\ 

is an ergodic average of the p— moment of the local (positive) expansion rate. 

As a consequence of the Oseledets multiplicative ergodic theorem, Lya- 
punov fluctuation moments xf^ ( x ) exist whenever 

\n + \\g p {x)\\eL l (M^) (9) 

This cocycle construction provides a unified description of the fluctuation 
ergodic parameters previously considered by several authors [H] [TTJ [16] 

m m. 

Existence of the limit OH]) depends on the integrability of 



exp ki^i [ x 

Xi (x) being the local expansion rate at the point x and ki the multiplicity of 
this particular rate. However, the expansion rate random variable may fail 
to have moments for large p. In that case complete characterization of the 
fluctuations may be obtained by the ergodic equivalent of the characteristic 
function. 

Definition 2 The Lyapunov characteristic fluctuation function C (a) is de- 
fined as the limit |3]] when the generator of the cocycle is 

g a (x) = exp (exp (ia ln + (Df {x)))) (10) 
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As before, existence of C (a) depends on integrability of ln + ||<7 a (x) || and, 
because exp (ialn + (Df (x))) is bounded, this is always fulfilled. 

Although C (a) contains complete information on the statistical proper- 
ties of the local fluctuation rate a full ergodic characterization of the dynamics 
should also contain information about correlations at different points. The 
ergodic parameters obtained from the Hessian in a variational formulation 
[T5] already contain partial information on the correlations, but a full study 
of this problem is far from complete. 



3 Dynamical Renyi entropies and fluctuations 
of the local expansion rate 

Another way that has been used |TT] [12] [13] [23] to go beyond the Lyapunov 
characterization is the construction of generalized entropies. 

Let $ be a partition of M and j</>^ j the elements of the partition $ n 
(partition refined by the dynamics /) 

n— 1 

* B =y/-($) (11) 

i=0 

Then, the dynamical Renyi entropy of order a is 

K(a) = supjlim -J_I In y;/*(^ B) )°l (12) 
$ I n^oo 1 — an \ J \ 

The sup over all possible partitions (or the existence of a generating partition) 
is not, in general, easy to establish. Therefore, an easier to compute (but 
not necessarily equivalent) definition uses a partition of the phase-space in 
uniform boxes of side e [23] [21]. Let the invariant measure be absolutely 
continuous with respect to Lebesgue. Then, denoting by p(iQ---i n -i) the 
joint probability to be at the box io at time 0, to be at box i\ at time 1, • • • , 
and to be at box i n _i at time n — 1 

K B {a) = lim lim - — — -In V] (p (i ■ ■ ■ i n -i)) a (13) 
e^O n-+oo 1 — an z — ' 
io—in-i 

the sum being over all different blocks of length n. 
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This is the definition that will be used here to obtain an estimate of its 
relation to the fluctuations of the local expansion rate. The local expansion 
rate A(x) = Yl\>o e A< ^ of the dynamics (defined as in Section 2) implies 
that if the system is in box i$ at time it can go to A (io) boxes in the 
next step, then to A(i )A(ii) boxes, etc. Here A (if.) denotes the average 
expansion rate in the (small) box i^. Then, one obtains for the probability 
p (io ■ ■ ■ i n -i) the following estimate [23] 

fj, being the measure of the i box. Hence 

Kb (a) = lim lim In ( q n ' ^ / ' n ) 



e->on->oo 1 - an V \ V A (in) ■ ■ • A (i 



tn-2. 



q n being the number of different blocks of length n and (■ • • ) denoting expec- 
tation values over blocks with this length. q n is obtained from normalization 
J2i - in . 1 P( i o--- i n~i) = 1- Then 



Kb (ct) = lim lim 




^(«o) \ 1 / ( A* (*o) 



E-yOn-K»l-an \\A(i ) ■ ■ ■ A(i n _ 2 ) / \\A(i )---A 
In the lim^^oo one may write 

K B (a) = lim lim In / exp ( (1 - a) V In A (i k ) | \ (15) 

E->on^oo 1 — an \ \ £^ J I 

This establishes the relation between the dynamical Renyi entropy and what 
some authors [11] [23] [TJ] call generalized Lyapunov exponents. 

One recognizes in the above expression (1 — a) Kb (a) as the pressure 
function for the random variable Y n = - J^LglnA (ik) [21]. Therefore, if it 
is differentiable (in a), its Legendre transform 

I (y) = sup {(1 - a) y - (1 - a) K B (a)} (16) 

a 

is the deviation function for the large deviations of the random variable 
Yn = - Xlfc=o^ n ^- * s ' ft characterizes the probability P n for finite- 

time fluctuations in the computation of the sum of the positive Lyapunov 
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exponents. 

( 1 n-2 ^1 

Pn \ ~ zJ ln A ( ife ) G fa» f + f x exp fa)) 

the symbol x meaning logarithmic equivalence. 

This establishes a general relation between the dynamical Renyi entropy 
and the fluctuations of the local expansion rate. Under more strict conditions, 
that is, if the correlation between successive values of A (ik) decays sufficiently 
fast, namely if 

(n-2 \ \ n-2 

(1 - a) In A (i k ) ) ]J (exp ((1 - a) In A (? fc ))) _1 < Cl e C2 ™ 7 
fc=0 / / fc=0 

(17) 

with c 2 > and 7 < 1, then 

K B (a) = lim — ln (exp ((1 - a) ln A (i))) (18) 

e^O 1 — a 

which one recognizes as a cumulant generating function. Summarizing: 

Proposition 1 The Legendre transform of the (box) dynamical Renyi en- 
tropy is the deviation function of the local expansion rate. If the weak corre- 
lation condition (11) is verified then 

00 

K B (a) = lim^A; s (lnA)(l-a)^ 1 (19) 

£ ^ s=l 

where k s (In A) are the cumulants of the local expansion rate. 

In its range of validity Eq. (fl9|) is a generalization of Pesin's formula [21j. 
Grassberger and Procaccia [26] have also obtained a similar, although more 
complex, relation between the dynamical Renyi entropy and the fluctuations 
of the expansion rate. 



4 Ergodic parameters and measures of com- 
plexity 

To have quantitative measures of complexity and self-organization is an im- 
portant issue for a mathematical theory of complex systems. The algorithmic 
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complexity [28\ [29\ of the signal generated by a dynamical system, that is, 
of the sequence of numbers coding a particular orbit, is the limit 



Ck (S) = hm ^1 (20) 

n-*oo n 

where M n (S) is the length of the smallest program (code plus data) able to 
generate the first n symbols of the sequence. Up to a factor, the average 
algorithmic complexity of the sequences is identical to the Shannon entropy 
[30] of the system considered as a source emitting the sequence. 

The notion of algorithmic complexity applies to each particular sequence, 
whereas an ergodic invariant like the Kolmogorov-Sinai entropy is a statistical 
parameter referring to the average behavior of the orbits. Nevertheless, the 
two notions are related. Let in M n (S) distinguish two components 

M n (S) = c x (n) + c 2 n (21) 

where c\(n) is the length of the code and c^n the size of the input data. C2n 
is the part of the information that is not explained by the program code. 
Therefore, as far as the model program is concerned, c^n is the random 
component of the sequence. In general — > when n — > oo and only 
the random component contributes to the algorithmic complexity. For this 
reason, in many cases, the algorithmic complexity of typical orbits coincides 
(up to a factor) with the Kolmogorov-Sinai entropy [31] [32J. 

The algorithmic complexity, the Shannon entropy and the Kolmogorov- 
Sinai entropy (rate) measure the degree of unpredictability (or irregularity) of 
the system but not necessarily the difficulty of modelling it from experimental 
observations. In fact a system generating completely random sequences has 
maximum algorithm complexity, but may be modelled by a simple random 
number generator. 

A better characterization of what is usually meant by complexity is the 
notion of excess entropy [33] or effective measure complexity [T3] [23J. Let 
Pn(si ■ ■ ■ s n ) be the probability to find the block s± • • • s n of size n. Then 

H{n) = - J^Pn(si * * * S n ) l0gp n (si * * * S n ) (22) 



and 



h s = lim -H(n) (23) 

n— too n 
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is the Shannon entropy. 

The difference -H{n) — h s represents the additional information (beyond 
the one obtained from size n blocks) that is needed to reveal the true long- 
term unpredictability of the system. Summing all these differences, the excess 
entropy E grows with the amount of effort (and time) that is needed to 
construct an accurate model of the system. 



It is a measure of the diversity of dynamical structures that is present in 
the information source. The nature of the information processing employed 
by the dynamical system to produce its unpredictability is captured by the 
statistical complexity C s [36] [37], related to the excess entropy by 



meaning that, given an event, the ideal prediction of another one requires an 
amount of information at least equal to the mutual information between the 
two events. 

The Kolmogorov-Sinai entropy, bounded by the sum of the positive Lya- 
punov exponents (an infinite-time average), is a measure of the complexity 
of typical orbits. On the other hand , it is to be expected that the finite-time 
fluctuations in the calculation of the Lyapunov exponents be a symptom of 
the diversity of dynamical structures. Therefore these fluctuations might be 
related to the excess entropy and therefore be a measure of the dynamical 
complexity of the system. Here such a relation is established. 

One uses the large deviation principle that states that the Legendre trans- 
form / (y) (Eq. ffToT) ) of (1 — a) K B (a) (in Eq. ffTo"]) ) is the deviation function 
of the random variable Y n = - Yl^Zo m ^ For invariant measures ab- 
solutely continuous with respect to Lebesgue, the average value of Y n is an 
estimate of -H(n). Therefore one may write 




n 



(24) 



E<C S 



(25) 




(26) 



with yi min being the value that minimizes I (y) and 



One sees that a dynamical complexity measure E e analogous to the excess 
entropy E may be computed from the ergodic parameters that define the 
fluctuations of the local expansion rate. 

In Ref. [ID], the authors have proposed to measure the increase of self- 
organization between time t\ and ti by the change in the statistical complex- 
ity 

AC s = C s (t 2 )-C s (t 1 ) (28) 

if this is not due to the action of an external agent. Given the relation f )25|) 
this might also be estimated by the change of excess entropy. 

This might be an appropriate notion when one is comparing two different 
states of an evolving system. There is however another aspect of what is 
usually understood as self-organization in multi-agent systems that relates to 
the interrelation between the dynamics of the agents (and their local cluster) 
and the global collective dynamics. This aspect is better characterized by 
the relation between the Lyapunov exponents and the conditional ones (see 
[6J and [T] for details). 
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